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^"ri . Abstract. The LSND and KARMEN v oscillation experiments are compared in order 

fT , ' to clarify the significance of the apparent disagreement between their results. 



> '. Introduction 

(N 

Q ■ The LSND experiment, performed at the Los Alamos National Laboratory, and 

CN . the KARMEN experiment, performed at the ISIS spallation facility at Rutherford 

Q^ i Appleton Laboratory, give results that appear to be in conflict. Both groups ex- 

G^ I perimentally investigated the possibility of z/^ -^ u^- They expressed their results 

^ ' in terms of a two-neutrino oscillation model in which only the muon and electron 

^ . neutrinos are relevant, so that the probability of observing an electron neutrino of 

Qh! energy E,^ MeV a distance L meters away from formation of a muon neutrino is 
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with Q the mixing angle and bvr? the difference in eV"^ between the squared masses. 
LSND has published evidence for a signal [1], and includes more recent data in 
figure 1. But recent KARMEN results, presented in conferences such as Neutrino 
'98 [2] and shown in the same figure, exclude almost all of the favored LSND region. 
Both experiments have competent personnel (this author is in LSND), and both 
have been working a long enough time to eliminate serious mistakes. How, then, 
do the experiments differ, and are their results really inconsistent? 

Comparison of Experimental Methods 

Both experiments produce neutrinos with intense, 800 MeV proton beams. These 
beams hit targets and create, among other things, tt"*" mesons, which decay mainly 
into [i^v^j^^ and the [i^ mesons almost all decay at rest into e^v^Vp^. The experiments 



KARMEN Oscillation Limit (Unified Approach) 
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FIGURE 1. Comparison of preliminary LSND t'p 



results with those of KARMEN and 



other experiments. Everything to the right of the leftmost curve is excluded to 90% confidence 
level by KARMEN; the light and dark filled regions are ones favored by LSND. 



investigate whether the resulting z/^ oscillate into p^) which are detected by the 
reaction z/gP -^ e+n. Both the e"*" and the n are detected in a large, liquid scintillator 
detector, the n by delayed scintillation light caused by the 7 from neutron capture in 
the detector. One might think that vr" would be produced in the target along with 
TT"*", and that the antiparticle decay chain would lead to serious v^ background from 
yU~ -^ e~Uei/^. But the beam and target consist of matter, rather than antimatter, 
and that makes a great difference between the vr"'" and n" decay chains. Production 
of 7r~ is about 1/8 of 7r+ production, tt~ decay is suppressed by a factor of 20 because 
these negative particles are attracted to positive nuclei in the target and are usually 
absorbed before they can decay, and fj,~ decay is suppressed by a factor of 10 for 
the same reason. Thus z/g production in the target is more than three orders of 
magnitude below z/^ production, allowing experiments to be sensitive to very small 
probability of z>„ — > Ug oscillation. 



There are important differences between the beams of the two experiments. The 
LSND target was H2O followed by a drift space, allowing tt^ —> fJ'^'^ti decay in flight 
at the 3.4% level, while KARMEN's target was Ta + D2O with no drift space; so 
only 0.1% of its tt"*" mesons decayed in flight. Thus LSND could, and did [3], also 
measure the charge conjugate oscillation, t'^ ^ fe, by detecting higher energy decay 
in flight neutrinos with i/gC -^ e^X. Other significant differences were that LSND 
had 1 ma proton beam intensity instead of KARMEN's 0.2 ma, and LSND had 
a much larger duty factor than KARMEN, 0.07 instead of 5 x 10"*^. KARMEN's 
tiny duty factor was a great advantage, because the two experiments suppressed 
and measured cosmic background by comparing data with and without beam. 

There are also important differences between the two detectors. The LSND 
detector was centered 30 meters from the target, rather than the 17.6 meters of 
KARMEN. This greater distance of LSND lowered the neutrino flux, but increased 
the oscillation probability with low Sm^, and made the experiment sensitive to 
somewhat different Sm^. The LSND detector was over three times as large as 
KARMEN's, 167 tons of scintillator instead of 56 tons. LSND had a single tank 
whose walls were covered with photomultiplier tubes. KARMEN, on the other 
hand, was segmented into 512 modules. This segmentation gave KARMEN better 
position resolution, especially for the low energy 7 produced upon capture of the 
neutron from UeP — ^ e^n. LSND used a much lower concentration of scintillator in 
the liquid. KARMEN therefore had a factor of four better energy resolution, which 
can be useful for distinguishing between neutron capture 7's and the lower energy 
accidental 7's from radioactivity. But KARMEN could not distinguish between 
neutrons and e"*" nearly as well as LSND. Because the LSND detector was one big 
tank with a low concentration of scintillator, the requirement of Cherenkov ring 
detection could exclude almost all high energy neutrons produced by cosmic muons, 
and the e"*" direction could be measured. Two other advantages of LSND were a) 
surrounding the detector was a superior veto against cosmic muons, and b) it had 
more shielding against neutrons from the target. The first of these two advantages 
was eliminated in 1996 by an upgrade of KARMEN's veto. The KARMEN data 
shown in figure 1 are based entirely on 2897 coulombs of integrated proton beam 
taken after their upgrade over a three month period. LSND's results shown in that 
figure are based on over 20000 coulombs collected between 1993 and 1997. 



Comparison of the Analyses 

LSND's analysis was more complex than what KARMEN used for its Neutrino 
'98 [2] presentation. LSND distinguished e"*" from high energy cosmogenic neutrons 
by requiring the showers to produce a good Cherenkov ring, to have a larger portion 
of fast light than would come from pure scintillation, and to be confined in position. 
The e"*" energy was required to be high enough to avoid z/g ^^C* -^ e~n ^^N contam- 
ination, but not too high to be from oscillation of z/^ from decay at rest of ^"'": 
20 MeV < Ee < 60 MeV. KARMEN's energy cut was 20 MeV < E^ < 50 MeV. 



Both LSND and KARMEN suppressed cosmogenic neutron background by exclud- 
ing events with a veto counter signal. LSND also excluded events with evidence 
of something other than a neutrino entering the detector by looking for even small 
veto signals and by using the e"*" direction and position to tell if it entered from 
outside. LSND used information from both before and after the e"*" to exclude 
events caused by /x -^ evv, and KARMEN used only information from before the 
e"*" for that purpose. 

Once events with an apparent e"*" were selected, both KARMEN and LSND se- 
lected events with a delayed 7 from neutron capture. Both experiments required 
the 7 to be near in both space and time to the e^ and to have a reasonable energy. 
But KARMEN made its selection through cuts in position, time, and energy, while 
LSND needed a more elaborate analysis since it had poorer resolution in these pa- 
rameters. For LSND, the product of the position, time, and energy distributions for 
correlated neutron capture events was divided by the similar product for accidental 
7's to form a likelihood ratio, R. High R corresponds to a 7 that appears more like 
a neutron capture correlated with the e"*" production, and low R corresponds to a 
7 that appears to be accidental. LSND could then either cut on high R in order to 
select clean candidates, or it could fit the R distribution to measure and subtract 
the contribution from accidental 7's. It did both. 

KARMEN used plausible criteria to optimize cuts by computer, while some of 
LSND's cuts were chosen with a less systematic attempt to avoid human biases. 
Instead, LSND verified that its results were not very sensitive to variations of cuts. 

In order to exclude VeC -^ e~X, which almost always has measured e~ energy 
below 36 MeV, and which is the largest background with no correlated 7, LSND 
cleaned its sample by further requiring Ee > 36 MeV. It then required i? > 30 
(nearly unambiguous correlated 7), leaving 22 beam-on events and 36 beam-off 
events. Since LSND (beam-on time)/(beam-off time)=0.070, cosmic beam-on back- 
ground is estimated to be 0.070 x 36 = 2.5 events. There was a beam-associated 
background of 0.4 events with a correlated photon from z/g produced in the beam 
dump, and the measured R distribution of accidentals was used to estimate 1.7 
events with an accidental 7. This left LSND with a measured excess of 17.4 events, 
a signal for which conventional processes cannot account. The probability that this 
was due to a statistical fluctuation is 4.1 x 10^^. 

KARMEN, after its cuts, found zero beam-on candidates with an expected back- 
ground of 2.88 ±0.13. The frequentist "unified approach" of Feldman and Cousins 
[4], led to the 90% confidence level exclusion limit shown in figure 1. 

LSND's contribution to figure 1 was done without the tighter Eg and R cuts used 
to establish the existence of apparent oscillation events. Instead the R distribution 
was used to measure the background from accidental 7's, and that background was 
used in a likelihood function of sin^ 29 and Sm^, based on the data's distribution in 
R, e"*" position, direction, and energy. The largest likelihood regions are the favored 
ones shown in the figure. 



Critique 

KARMEN's 90% confidence region is misleading. A 90% frequentist confidence 
region is one chosen by a method expected to give the truth 90% of the time it's 
used. That doesn't mean that this time the method has a 90% probabihty of giving 
the truth. For KARMEN's particular experimental result, frequentist methods can 
give a region with much less than 90% probability of giving the truth. For example, 
if KARMEN had used the conventional frequentist confidence region, instead of the 
"unified approach" , it would have zero percent probability of giving the truth, for 
the region would be empty, excluding both sin'^29 > and sin'^26 = 0! This 
happens because KARMEN found no events, a somewhat surprisingly low result 
even under the assumption that sin'^26 = 0. While the "unified approach" cannot 
give an empty region, it can give one that is too small. In the absence of a priori 
assumptions one cannot prove that a non-empty region is too small. But if one 
takes the usual Bayesian a priori uniform distribution in the unknown parameters 
{sin^26 and drn^) then the region allowed by KARMEN with the "unified approach" 
covers less than half of that allowed by the 90% Bayesian probability. 

Figure 1 shows LSND regions surrounded by contours of 0.1 and 0.01 in (like- 
lihood) /(maximum likelihood). These favored regions can be misleading if inter- 
preted as confidence regions. I therefore compared KARMEN's Bayesian 90% limit 
with LSND's data reanalyzed to give 90% Bayesian upper and lower limits. For 
simplicity, the fit ignored position and energy information. But unlike the figure 
1 result, this fit itself used R to correct for accidentals, instead of getting the cor- 
rection elsewhere. Figure 2 shows the result, based on the same events as figure 1, 
but with the effect of uncertain backgrounds lessened by requiring E^ > 36 MeV. 
Not only is there no inconsistency between LSND and KARMEN, but the figure 
also shows that LSND's u^ -^ v^ 90% frequentist confidence region [3] is consistent 
with this way of analyzing LSND's z/^ -^ v^ data. 

The LSND analysis of figure 2 can be replaced by one whose requirement of 
E^ > 36 MeV is replaced by E^ > 20 MeV. In that case, the lower LSND 90% limit 
shifts up almost a factor of four relative to that of figure 2. This probably happens 
because more high R events are seen than are expected from intermediate R. Since 
low Ee data have especially high background, high R, clean, events contribute more 
strongly to a fit with more low energy contamination. Fit results might then be 
increased by an upward statistical fluctuation in the number of high R events. 

The alternative analyses shown in figure 2 are in some ways inferior to the ones 
LSND and KARMEN have reported elsewhere. It is better to include Eg and event 
position in the LSND analysis. Frequentist methods like the one KARMEN used 
do depend less on controversial a priori assumptions of experimentalists. The point 
of figure 2 is that statistical fluctuations, combined with the details of the method 
of experimental analysis, still allow too much freedom in the experimental results 
for us to conclude that the two experiments really disagree. 

LSND at the time of this conference is just finishing up with the last of its data 
collection, and will not increase its statistics much over what has already been 
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FIGURE 2. Comparison of preliminary LSND j/^ 



results (filled region) with those of 



KARMEN (dashed cm-ve), Bugey (dot-dashed), and NOMAD (dot-x-dash) . KARMEN's exclu- 
sion curve is 90% Bayesian confidence level, while the LSND region is bounded by 90% Bayesian 
upper and lower limits with 36 < E^ < 60 MeV. The pair of smooth curves surrounding the 
LSND region gives the LSND 90% confidence region for v^ -^ v^ oscillation. 



reported. But LSND analysis is still underway. For the z/„ 



Vc- 



analysis [3], LSND 



significantly improved particle identification, and position and energy resolution, 
all while using methods of cut selection that avoided human bias better than past 
^p. — ^ ^e analyses. The v^^ -^ v^ results were also displayed as a true frequentist 



confidence region, unlike past LSND 



Vf. 



results. What was learned and 



invented for v.. 



is being applied to a joint analysis of both v^ and v^ data. 



The upgraded KARMEN will eventually have much more data than were reported 
at Neutrino '98, and its analysis is also improving. 

Perhaps the two experiments will eventually resolve their differences. 
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